Multimodal generative models are leading a new trend in artificial intelligence, focusing on the integration of visual and textual data to create multifunctional AI systems that perform various tasks, from image generation to understanding and reasoning across different data types. A key challenge is to enhance the capabilities of autoregressive (AR) models so they can generate high-detail images based on textual descriptions. While diffusion models excel in generating high-quality images, AR models lag behind in image quality, resolution flexibility, and multitasking capabilities. Researchers from Shanghai AI Lab and The Chinese University of Hong Kong have introduced Lum

A collaborative effort between the University of Alberta, the University of Toronto, and Huawei's Noah's Ark Lab has led to the development of a new method called TexGen, aimed at solving the challenge of generating realistic textures in the field of 3D modeling. This technology generates corresponding 3D textures from text descriptions, significantly outperforming existing techniques. The core involves a multi-view sampling and re-sampling framework combined with a pre-trained text-to-image diffusion model. This method effectively reduces discrepancies between views by maintaining a texture map with RGB parameters and updating it after each sampling, achieving view-consistent texture generation. An attention guidance mechanism has been introduced.

Researchers from the University of Hong Kong and Tencent have proposed a new paradigm for multimodal recommendation systems called DiffMM, aiming to enhance the accuracy of short video recommendations. The system creates a graph containing user and video information and utilizes graph diffusion and contrastive learning techniques to better understand the relationship between users and videos, thereby achieving more accurate recommendations.The model method of DiffMM primarily includes three part